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ABSTRACT 

A^general computer program for estimating the unknown 
coefficients in a^'set of linear structural equations is described. In 
its most general form, the variables in the equation system may be 
unmeasured hypothetical constructs or la?tent variables, and there may 
be several measured variables or multi^e indicators for each . ' 
unmeasured variable. Also, the method allows for both errors in 
equations (residuals, disturbances) and errors in the observed 
variables (errors of measurement, observational errors) and yields 
estimates of the disturbance variance-covariance matrix and the 
measurement error variances, as well as estimates of the unknown 
coefficients in t'he .structual equations, provided that all these 
parameters are identified* The method is so general and flexible that 
it is possible to handle a wide range of models. The model considered 
here ds a generalization of th^ model considered by Joreskog (197 3)*' 
(Author /DB) ' 
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\ .ik-ru-ral Com])ut£r ProF^t^am for 1 stimating a Linear f^M-ucLural 
• KqiiaUon System Involving Multiple Indicator.s' of 
Unmeasured Vai^iables 

/ 

1. Entroduction , 

V/e shall describe a general corriputia^ 'procrani for estimaLinc ih^^ unVjiOvin 
coefficients in ^ set of linear structural equations. In its most general 
'form the variables in the equa-tion^3ystem may be unmeasured hiyTjothctical 
constructs or latent variables and there may be several measured variables 
or -multiple indicators for each unmeasured variable,. Also, the method allcv^ 
for both errors in equations (residuals, disturbances) and errors in the 
observed variables (errors of measurement, observational errors) and yields 
estimates of the dist'Jirbance variance-covariaifce matrix and the measurpm.ent 
error variances as well as estimates of the unknown coefficients in the 
structui^al equations, provided that all these parameters are identified. 
The method is so general and flexible that it is porsible to h-^- 'iIj a wide 
range of mo'dels^ for example, path analysis mo'dej.s (Wright, 195^^, 
i960; Turners Stevens, 1959; Duncan, i966; Duncan, ^ Haller'Sc Fortes, ^n)s§^ 
Land, I969: Heise, 1970: Blalock, I969,' 1971 5 Costner, I969; Ha user Sc 
Goldbl^rger, l97l), econometric models (Ooldberger, Ipo^f; MaLinvaud, l^-fC: 
Johnston, 1972), factor analysis and covariance s-^.ructure models (jyre3ko(:; 
1969^ 1970)* The model, considered here Is a generalization ol' th( ^■'^'^'■'^ 
considered -by j5rt^skog (1975)* - ' 



The ilfncral Modt^^l 



'nsid( r raiido^n vectors: fj* - ^ • • • ) ^^^^ (% ^ -^^^ • • ) 

?r true dependent and independent variables, respectively, and the foLl/'^. I:. 



:/sto!r of linear structural rdatiMS 



(:.) 



vheVe B(m x n) and r(m y. r!) are coefficient matrices an^ '* (C.*C^^, 
* ) 'is a random vector of residuals (errors in e^juations, randori 
disturbance .t'^-rms), V/ithout loss of t^enerality it may be aosumed that 
^(''i) =^ ^'(O ^ sind. t{i) ^ 0 • It is furthermore- -assuned that C is 
uncor related with ' T; and -chat B is nonsingular. 

The vectors n and I are not observed but instead vectors = 
b.rJry-^rJ^) and-x* = (x^-o^ • • -^^^n) are observed, such that 



y = (i t A T] ■' f 



X V T ^ -t 6 



where \x = €(y) , v ~ f'(x) and and are vectors of errois of 

measurement ih y and x , respectively. The matrices /\^n x-n) and 
^^^.(^ J^) are regression matrices of y on t] and of x on t ^ 
resr)ectively. It is convenient to rcfi^r to y and x as the^obscrved 
variables and t] and -^^as the true variables. The errors of measurt— 



ment are assume 
variates. 




e uncorrelated with each other and with the^ true 



V 



J 



4 / 



Let <^{r, : n) and 'j(v\ x r.) ul- Iho yarjancc-covai-ian j; ':iitrlco3 'ji 
: and ; ^. resveetively^ ^'^ and the dia(5onal' Tiatricos of error ^.^ 

\^riances Tor y and ^ recpectively. . Then it f'^llov/s^ :>on ohe above 
assumptions,, t^&^t the varianc«.'-covariance na'tri': £[(t ■ o) ' (; - q)] 

• ■ ' A J' • • 

The elements of E arc functions of the olor^-nts of' A ^ A ^ r ; ,i . 

^ > t ^ and* G^-,. 'In applications some of these elements are fitcd 

and equal to assigned values. In partic"«ilar this js so for elements in 

A . A . B and F . but we shall allov; for fixed values in *the other ma- 
~y ' ' ~ ^ ' \ . ^ ■ ^ . 

trices also. For the remaining* nonfixed elements of the si>:' parameter ma't^'l'^!^ 

one or more si^ibsets m^y have identical but unknovm values'y^ Thu;: ^ l.(:rnent3. ' 

in A , A . B. , r . 0', t , ) and i" 'are of three .inds': 
~y ^ ~x ^ ~ ^ - • ~o ^ ^ 

(i) fixed parameters that have been asr^igned given values^ (ii) constrained 
parameters that are' unknovm but equarl to one or more other -T>arameters and 
(iii) free parameters that are linknown and not constr^ned- to be oquas^:c 
any other parameter. ^ 

Before an attemT)t is made to estimate a model of this kind. 'the x0.enti- 
fication jjroblem must be examined. Identifiability depends on the specifica- 
tion of fixed^ constrained^ and free parameters. Under a given specif ica- 
tion^ a given structure A^ ^ A^_, B ^ r ^ ) - ^ > ; tP^ generate.: 
one and only one E but there may be several stractures genera tin/^. the / 
-same 1) ♦ If two or more structures generate the same the-^ struct iu*es 



^ lent strvctur^ G, Ihe :.jara!net',r ic raid to b^. id' riti fi^.d. li all _rfarar:xoC'rc 

• of uhc .tr.odej. ai-e idwitified. the viholl- Kiodt-l iz said "go !>) idcntiriod. 

• Vv^.en'a r^dol ir. identified one can -lo^oally find r;'.r:::i:' t^r:v • : \ ' ".'j.',' -x 
lie parameuers. Identification Tjroblorn^; arid<-r roiric ci^ociaL cary.r: 



'general model are considered b;. G*-raci and '"lOldb'^-rcer (r/7l)\ ^ 

^ . \ ^ 

,l*r^ I-Jotimtion of the Gem'ral X^del 

Ix. is asnuraed; that z - X'y^^^O* =^ mltivariat^ Vonrx^l di.':tribuLi''- 

v;itri^*"mean vector (f-'Sv/)* and vari^nci -covariancc -latri:' * )Z - , 

t * * - ~ ~ ' ' . ~ • 

Let /Zo; • • 2,, b^' . obserV^tionc of z'-- • Sinc" no 

constraints are imposed on the tr.ean ^ector (pS^*)' ma>irra:r. lih-1]- 

hood esbimaoe of thi? is the usual satnr.ie m^an vector z - (r/*^-*)* . I/ ^ 

* * . 



vith 
as 



, bo the us-Jial sarn}de vari^^nce-eovfjrianci -"atrl/, T.artitic,!. 



V 



S[(p ' q) >: (P •■' qVi ^ 



B;..(q.>. r.) ^ ('-i :> 1)' 



^ <■)' 



The logarithm, of the likc-llhood f'mccion, - oraittJnr a fx'' j";' on - f ur..- 
obsc-j-'/sLions, is p;iven by • ' • \ 



V 



v^f-rrnQct: to those' taking'into acjojint. tha^ :-^.r- ' r t.- :r^-^ b' I'lr-^d ar/i ^ 
.;or-(: :r.ay be c-qpstx^ained to be equal to ::or.e oth^rr... ya>an.izxr. .Lor;- i--- . \^ 



ir equivalent to ninimizinf^ 



•p (l/2>[MO;; Ir/! ' u^(SE'-) 



(0 ^ 



S'lch a rrdniriiiza^ion vvobH^A^i may be fortnaiiciod fol-lov.'G. 

• ^ Let A* = ( A ,A^, /A ) b^ a vtcLor all* tee clement. - of 
> r , , v'*^ V , find * arranged in a 'rescribcd -^r^er. ">-n , ? 

•ipy be re^iarded as a function r(A) of /^-J;>^2-' * * '^^^ ^ •^'^'^i*^^''- contir!:uouc 

• 2 ^ • 

and has continuous derivativr^s uF/u7v^ and ;.' ^A'\^'\ l*-^^-'^ '=^^^i<i 
aecond order> evZcepT: v;ho"n^ -is sin(:'^.ar. Ifie totality of ^:hep.^/ 
deri^/atives is represented "b'j a gradient, vector uF/jX and a sy^nnetrj j 
rnatriv u v/vlsil ' . ::ovj le^: so^me r - s "of tBo V be fixed and denote* 
the ren^ininr iJz by :r, ^ . ^ n / '3'<r 'The function r is nov/ 

' considered^as a f^^ction ^j(^0 ^1 '^2^ * * * ^ ^s * !)♦ rivative.:; 

and ^S^OhTiuTi' '^c^: obtained frori ''F/cX and:' u f/c>.uX* by oraittinc 
and coluinns corresT)ondin;: u*:^ tne I'i /'-d^'^' ' s. * Airion/; jt, ^ :r2; • • • ; ; i-'^ 

^thcr^be .some t ^distinct parar:*'ters denoted ^] ^ "^2^ * * * ^ '^t ' " S •'^ ^ 
• » 

CO tha*t xrach .it. is eq-jal to on- a?:d ''X\lj 6iv r:.. , but j ossibly several 

j^U'. eoual ^e Gamo'^< . I" t K = (k. .) -b^- a ^iatriS of order s : t i/ith 



elements 
(or G )' 



1 if jt/^ and k? , - 0 oth«*i"v/ise . The fuxiction 
a fimct ) c f ^ k^^ . . . ^ < . . and v;e have ^ 



V 



V 



(0 



erJc 



2h'JSf th*4'>^orivatives of H are simple suns o'r the derivatives of 

The -^.inimization of iT> nov^ a $trai;;;htforv;ard applj cation o:] the 

"^avldon-Flvtchcr-Pov/ell mcth^xl (Fletcher 5: Povoli^ l;^^o) usin^j; a corrr^^tfr 
rrof^ran: by ^ruvaeus andS'^reckog (IS-YO)^ This ir.ethod rnakcs ase of a natri" 
7, ^ 'jhich Tjvaluatied in each iteration. Initially E * is any tyositive 
definite r^atrix a2;r'royi!natin:^ tiie inv*rrse of 'I/okok^ . In 'subsequen^j 
iteratior?s Js irn})roved^ usini*; the inforrration built up ac^o^^^ the func- 
tion that ultimtely eon.ver/jes to an a£;j;ro/ imation of the i>*i^rso*^of 
^'^il/v-'cc-:^ at uhe rdnimrn* li' there We many T}arameters^ the n'jmber ^ 
iteration:- nay be excessive^ but ^an be considerably decreased by the 
l.x-ovi^^ion of a .rood initial estiirate of 7 . Such an estimate may be ob- 
t-iined b;. inveroing the inforrration matri/ - ' . ^ 



vh'-T'.- {-'(c- <',jfvn^jii' ) is obtained fr- r:' _ ^ 

{■{/f/uAo?^' ) i.'f(c)F/c'' 'f/"''-V) ■ ■ 



(11) 



by omiooi:n/3 rov;s and colurrm-^Lorrunpondinr to .the fixed V/hen the 

tr.inina^r: of har: been found^ the inverse of the irtformabion m*'trix my 
h^' c'^mr^uted ^':ain to obtain standai^d e^Srdjrs of^all the i^arameters in < 
t; ";:e."^-VaJL trx-thod for obtaining the elements of , t'(y'F/dJ\i^?/oV ) has be( n 
f'iv^n b:, J"reskorr (19^5).^ . ' • * 



I: : ror,::ii^Tr^?) be descrlbtd Yi'sTt- th'. info motion r^i^ZTiv i^^, not .r;^.d< 

T' i;;c til", inf .rfy.atiL>n rnatrl/ in th^- j r j;-^r?ir. S.-ouid rc-quir^r the v/ritinr; 

a r^irly c^^ '.rlicat^^d subroutine. Triis vill pj^-Gibly be done at a later 

tlr/. Ai. i'r^.seno the progr^irn v/orks roii<>v;s. The starting point, -^-lay 

'jho.'.^'n ^-rbitririly . Fi^orr; the startin/^: T^oint a n-:r.ber of cteer.es^i. de::a^nt 

ittrat-l \-i/ ar-. r^erf^rr-ed uatil the decrease in function" value- is lenc than 

'/ . /vt th^ n-v; v.ojnt, r.o obtaine^^, the D^iividon-netch'-r-Povrc^i I r.rocedur-' - 

3tar';r ;.jt:i ^ ^"^^ -^hj/^n i.: 3n" identity r.atriy. o 

/ 

- • The a]n:<lication. of tnc i)avidon-Fletcher-Pov;ell method requires lormula;. 
for the dvri-V'ttives of-'F '--/ith respect to the elements of A ^ A B , 

m 

r , : . , ^ &nd V . These may be obtained by rratrix different!-- 

ation. V.ritinr. A - D = 3'"^r , C = ''dM/ + AtA* y and 




'-y>" 



(15) 



t-'^ derivativer; are 



oF/oB = -A'A'(;2 A c + n' A'fPiy) 



•F/c-r A 'A' A D -i .1' A > 



vhcro / 



Z ^- D^^^: A D A D DVs/. * /. A^Q A 



uF/u6' AV^'a A A - ciiag(A^\^l A A) 
T( sts of l{;yT)otheses 



. Vrnen the mxitnum likelihood estimates of the parameters h,ave,been ob- 

lainea^ tne f:oodne3s of fit of ''the T:nodt\l may be test^d^ in Mrr/- canj.le.^:^ 

by the likelihood ratio technique. ' Let be the null hypothesis of the 

iTiodel/ under the Givep specifications of fixed^ constrained^ and free j'alrari- 

evers.- First consider the*cas,e vhen the alternative h;>3JOthesis li^ is . ^* 

that Z is a positive definite matrix. Then minus twice the logarithm 

of the likelihood* ratio is IIF^ vmere Iv is the minimum -value of F . 

0 0 

rr the model holds^ this is distributed^ in large samples^ as x"^ v/ith 

d ^ I (m n)(m i n • l) - t (l-O 

degrees of freedom^ where^ as before^ t is the total number of indeDendeii 

iDaramieters estimated under il . . * 

Let II be any specific h:/T>othesis concerning the r-arametric struct'j^ 

of ohe general model and let \\^ be an alternative hypothesis. In large 

samples one can then test IL against 11 . Let Y be the minimum 

of^ ? under »L and let be the minimum of F under b' . Then 

^ 0 X • 1 - 

< and minus twice th^- logarithm of the likelihood ratio becomes 
K(F^ " •^''j ) • ■'^^ii''^ distributed app)roximat:ely as X' Vrith 

degrees of freedom' equal to the difference in number of independent 
pai'ameters estimated ilnder 11^ and h^ . ^ , o . 



To illustrate the ideas of thr, ^receding sections consider 7:he r.odel 

/ 

d'-^i-icted in Figvire 1. where circles denote true variables and .-qi^i-es 
denote observed variables. The other variables in the fi^^ire ar^- r^-r^id-ia 
or ^^rror variables. A one-v;ay arrow denotes a direct causal inflal^nce 
whereas 5 double arrow denotes correlation or covariation v-itHout a. 
causal interpretation. . The lwj arrov/s between ^n(^ denote recij; 

rocal interaction (simultaneity or interdependence.). ^ .\ ^ , 

The model in Figure 1 has i\ ^ h y -variab.lc^s^ q *7 "y -VcirinLl^-c 
r. - ? r\ -variables^ and i\ - ') -variables. The strvct'xral ^Ji'iB^tionz 
are 



or 




The two 7 -ooefricients in the i?irsr> equation ar?? assufned to be eq';al I-} 
illurtrate the idea of a constrained parameter. The '<r-:ati"ons ri-latinp^ 
the ob:K-rved and true va-riables are ' ' ^ . 



/ 



/ 



/ 



-ic- 



0^ 



5? 



5, 














1 



ERIC 



t 
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f^l' 








1. 0 
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\ ^ 
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(15b) 



and 







ri 




1 


0 


0 










A- 


0 


0 
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0 
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0 
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(15c) 



In (15b) and (l5c) one 7\ in each column of /T^^nd A has been set 

~y ^^C^ 

ecuial to one to fix the scales of meas'aiemcnt in the true -^^ariables. When 
a solution has been obtained, one can scale this so that all true variables 
have unit variance if this is desired. 

Data for this model wore (generated .by assigning the follo^ving values 



A 



3 ^ 



1.000 


0.0 




0.902 


0.0 




0.0 • 


1.000 




0.0 


i.095 




"l.OOO 


0.0 


0.0 


i.500 


0.0 


0.0 


0.900 


1.201 


0.0 


0.0 


1.000 


0.0 


0.0 


1.098 


0.0 


0.0'' 


0.0 


1.000 


0.0 


0.0 


l.i^OO 


' 1.000 


-0.it95 




-0.595 


i.ooo. 





♦J. - 
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>r _/ 0.599 
" l-i.ooo 



0.599 

0.0 ' 



0.0 

1-198, 



'0.999 

0.700 
10.601 



1.199 

0.500 



1.598/ 



0.506 
0.586 



0.705 



) , 



■a = diag (0.522, 0.1f52, 0.556, 0.1^52) , 

= diag(6.6l5, 0.515, O.I118, 0.522, O.Glh, 0.526, O.hih) 



to each of the parameter matrices. These generate a E ' according to {k), 

\ 

where 



-Ylf 



5.815 

5.195 
5.890 

1^.259 



5.068 
5.508 
5.81^2 



5.775 
6.182 



6.975 



Z 

~xy 



-XX 



O.76I- 
0.991^ 
l!.690 
0.855 
0.917 
iv259 
1: 65 

\ 



0.690 
0.896 
1.525 
0.755 
0.827 
1.156 
1.591 



0.176 
0.229 

0.5^^7 
0.157 
0.175 



0.195 
0.251 
0.580 
0.172 
0.189 
1.997 
2.797 



1.57^^ 










1.298 


1.952 








1-739 


2.260 


1^.221^ 






0.700 


o.'909 


2.069 


l.iv71 




0.768 


0 ..998 


2.272 


1.517 


1.822 


0.601 


0.781 


0.902 


0.500 


0.550 


lO.BIh 


i.09if 


1.262 


0.iv21 


0.1^62 













1.675 

1..958 



2.91!; 



In the Appendix this model is analyzed using the above matrices as S 

S , and S 
~xy ~xx 



I 



I 

I 

A 



•13- 



l.^p* A Model of Duncan, Halles; and Fortes . 

In a study on peer influences on aspirations-^ Duncan\ Haller^ and 
'Fortes (1968) gave several examples of path analysis models^ Their model 
IT is particularly interesting since it involves^Tb unmeasured variables. 
This mo'del Is reproduced here^ in different notation^ in Figure 2. In thi: 
models P = ^;.q = 6^ m=:2^ n = 6. The ^ix x -variables are 
assumed to be measured without error ^ so we take i, 



'1 ^'i 



i - 1.2y...^G y i.e.^ in terms of equation (';) v/e have A ~ I and 5 = 0 

~x ^ ^ 

The structural equations are 





1 
















H 

'6/ 



and the equations relating the t]»s to the y's are 



^2 




\ 


0 






0 


A.. 








'J 






\ 0 
\ 
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(I6a) 



(16b) 



D'oncan, Haller, and Portas postulate that the u's aie correlated with each 
other except that u and are uncorrelated and also u and u, . 

Ilowe^rer, the four correlations p(u^. u, ) , ; p(u^, u^^) , pfu^^u^) and 
pCug^Uj,) are not all lldentified. To "make the model ident.^fied one of them 
must be fixed and we have chosen to set pCu^^u^,) = 0 . Equation (l6b) is 
not in the form required by the general model. This is easily remedied, by 
i^ep^ga^enting u as 



4 



6 



-15- 



V 



0 


0 


^■6\ 






Q 


0 


^10 


0 


0 


0 











s 



(16c) 



^Ahere ^ ■ \ ^ ^5 ^ mutu§ill^ uncorreiated and of unit 

variances. . It should noted that there is a one-to-one correspondence 

betv;een the nonzero variances and covariances of u and ^/-^ • • • ^ ^i . • 

TO 11 

Introducing . 5y = ^ \ > ^9 = ^5 ^ ^10 - ^6 

« 

model may be specified as follows 
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^1 


0 


0 


0 


i1 
0 




■\ 






-''2 


''5 


h 


0 


0 


0 


0 


0 


0 




1 


0 


0' 


0 


0 








0 


0 


'5 






''8 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 








0 


0 


0 


0 


0 


0 •■ 


1 


0 


0 


0 


0 


0 


0 


1 , 


0 


0 




\ 




c 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 • 


0 


0 


1 


0 




•5 1 




0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


1^ 








0 


0 


0 


0 


0 


0 


0 


0 


0 


I 











0 


0 


0 


0 


0 


0 


0 


0 


0' 






^2' 
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0 
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0' 
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0 


0 
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0 
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0 


0 


0 


0 


:/ 






r6j 
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0 


. 0 


0 


0 


1 


0 


0 








0 
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0 



(iTa) 



(17b) 
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A. 
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0 












"2 




^2 


•• 0 


0 


A., 




0 










"5 


0 






0 ■ 




0 














^0 




0 


0 ' 


0 


^11 




1.% 



Furthermore one specifies 



P6 



/o\ 

6 
0 

W 



X 10) = 



tC6 X 6) = 



' Z (6 y. 6) 



0 
0 
0 
0 



Gg(6 :r 6) = 0 ^ 



0 
0 
0 
0 



y. 6) ■ 1(1+ >: i+) / 



0 
0 
0 
0 



0 
0 
0 



0 
0 



and 



Tliis model is analyzed l-n the appendix using the following data 
i-rom Table 1 of* Duncan, Haller^ and fortes (1968)- ('n = 329 ); 
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^5 


^1 


■^2 


'■5 


• "6 


\ 




.2220 


.1^105 


• .kok'::, 


.5555 


.1021 


.1861 


.2598 


.01^89 


.2157 


.271+2 


.0782 


.111+7 


•.0186 


.0859 


1.0000 


• .32kQ 


.koki 


.2502 


.0951 


.2707 


, .2786 




1.0000 


.621+7 


' .2995 


.07-60 


.2950 


.1+216 






1.0000 


.2865 


.0702 


.21+07 


.5275 








1.0000* 


.2087 


.2950 


.5007 










.1.0000 


-;oi+58 


.1988 












1.0600 


.5607 














1.0000 



s = 



1.0000 .1859 
1.0000 



.2905I 

.112!+!^ 

• 3051^: 
.5269! 

.5669: 
•5191- 
.27pl+' 
.1+105 

-.61+01+ 
1.0000 



1.6. A Restricted Factor Analysis Model 

Consider the model shown in Figure 5* This is a restricted "factor 
analysis model in the sense of.j5reskog (I969) and may be rnost conveniently 
analyzed by the method describec^.-in that paper. However, it -can also be 
analyzed using the model considered in this paper. To do 50 one specifies 



z i , i*ev one chooses B(5 x 5) = I , r(5 x 5) = I , and = Q 



The 



matrices A and A are as follows; 
~y ~x 



A = 

~y 





0 


0' 


\ 


0 


0 


0 ■ 


A, 


0 




\ 


0 


d 


0 








0 


0 





A = 



Ac 



0 
0 

a: 



2 2 

The matrix <|) is specified to be a correlation tratrix and 9^ and 5^ 
contain the' unique variances of the tests. An example is given in the 
Appendix . 



In 'this section we describe briefly Vnat the program does. , Details 
about the input and output are given in sections 5 and h respectively* 

2.1. ^'fhat the Program I>08S ^ / ^ \ \ 

The input >data may be a dispersion matrix^ a correlation matrix, a * 
correlation matrix with standard deviations^ or raw data from which th^ 
matrix to be analyzed can be computed. From the,inpu% matrix, variables 
may be selected to be exclnfled in the analysis^ so thai the matrix to be 
analyzed may be of smaller order than the input matrix. This selection 
procedure also allpws columns (rows) of the input rftatrix to be^ interchanged. 

^ The matrix to be, analyze'd may b^ sum.s of squares and cross products, 
deviation sums of squares and cross products, a dispersion matrix, or a 
correlation 'matrix. ^ 

Simplified versions, of the general model may.be estimated. That is, 
the user can specify to estimate a model where there are no disturbances, 
or a model ^faeiC there is no x ^ or a model where B - I . In these cases 
the equations are simplified and the m.inimization procedui'e is faster. 
Also, the user can request an accurate or an approxima^te solution. If an 
Accurate solution i-s reaaested, the iterations of the minirr.ization method are 
continued until the m.inimum is found, the convergence crit^^rion being that 
the magnitude of all derivatives be less than .00005* The solution is 
then usually correct to three significant digits. If an ap-oroximate solution 
is requested, the iterations terminate when the decrease in function values^ 

is less than %. The approximate solution may be substantially different 

2 

from the exact solution, but the residuals and the value of X will usually 



give an indication; of how reasonable the hypothesized model is. The option 
of an approxiirate solution has been Included in the program for the purpose 
, af saving computer time in exploratory studies when^ the primary purpose is 
to find a reasonable model. Once such a mo^ei has been 'found^ an accui^ate 
solution may be cgmputed. . & ' ' " . 

A TOriety of options for. tht output is available. ' Residuals may 
be printed. _ These are defined as the difference between rer»roduced (Z) 
and observed (S) \'ariances and coTOriances, which are useful for judging 
IhB goodness of fit of the model to the data. The standardized solution can 
be conrputed and printed if requested. X -is printed as an^overall goodness 
of fit test statistic.. The final niaximum likelihood, solution may be p-onched. 
on' cards if requected. • , 

2.2. nov Fixed, Free and ConstT^ined Parameters Are Specified - 

The elements cf the eight parameter r trices are assumed to be in the 
order ^ ^ B ^ T > ^ > > ®e > §5 ^^^^ within each matrix^ the 
elements are ordered row-v;ise. The diagonal elements of the diagonal ^r^urice 
0 and 9g are treated as row vectors and only the lovrer diagonal , parts 
symmetric o and are taken into account. 

For each of the eight paramet'^^r matrices^ a pattern matrix is defined,- 
'w'ith elements 0 ^ 1 . 2 *^ and 5 depending on whether the corresponding 
element in^'the parameter matrix is fixed^ free^ constrained follower and - 
constrained leader^ respectively. A constrained parameter is called' a con- 
strained leader the first time it appears in the sequence. The parameters^ 
appearing later in the sequence and assumed to be equal to the constrained 
leader are called constrained followers* 
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The ^bove technique defines uniquely the positions of the* f ed^ free 
and c<5nstrained leader parameters. It does not define^ hovever^ which 
followers gp with which?^leader^ if there is more than one leader. To <do 
so one must' also specif^ all the fpllowers associated with a given, leader. 
This is done by assigning to each leader and follower a -four-digit nuitiber 
MCCC^ where M defines the matrix in which the constrained parameter apr/ears 
and CCC defines the position of the parameter in that matrix. ^!uxs^ ' 
M = 1 for 'A^ , 2 foxrK^ , 5 for 3 for P , j'for o ; 6. for y , 
7 for 8 . and 8 for e^, For example, ^ 

^ kool 4qo5 50i4 

defines the first element in P ^ 7^ ^ to be equal to ^e fifth element in 

the 



) ^as v;ell as rhe fourteenth element in 0 ^ 4)^^ ^ where 7^ is 



leader and 7^ and are the followers. 

p l4 ' 

\' ' * . 

* Pattern m^Jrices have to be provided for each matrix containing both 

fixed and free parameters and for each matrix containing constrained param- 
eters* Patterns for matrices whose elements are all fixed or all free arc 
set up by the program. 

V/e give '^a simple example ^to illustrate the above specifications'^ 
Suppose 5 (3 X 5) and P (5 x 3) = I ; all elements in both B and 

P fixed^ (5 X :5) with all diagonal elements frfee^ and 



A = 



.^1 


0 ■ 


0 














5 


0 




1^-^ 0 


0 




1 




0 




0 




0 Ag 


0' 




0 1 




0 
0 


0 


0 




0, -6 










0 


















lb 


. . diag 




^1 


^2 


5 ^ p 
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5 o 



Jsr. = and e =9 , 
5 ° ^1 ^2 



The pattern matrices for A A. , cj and 9; are 



y 



5 0 0 

2 0 0 

0 10 

0 10 

0 0 5 

0 0 2 



A 



X 



1 


0 


o" 




0 


- 


0 


2 


0 




1 


0 


0 


0 


1 


_2 


1 0_ 



p^^v = [ 5 2 5 2 5 2 ] 



^and the specifications of leaders and followers are 
1001 lOOi^ 2005 5001^ 

1015 10.18 

7001 7002 
7005 700i^ 

7005 7006 ■ . 



In this mo'del fourteen indepe'riSent parameters will^be estimated. 



In addition to the above specifications for fixed, free and constrain^'^d 

parameters^ start values have to be given for all parameter ira trices, except 

when a simplified ikjdel is to be estimated (see 2,1). That is, if there are 

no disturbances, start values for \|r are not read in» If B = I , B is not 

^ - . ^ ~ ^ 

read in. *An^ if there is no x start values for A ' , T ^ o and G 
are rxot read in. The start values define the fixed parameters and the 
initial values for the minimization procedure for the other parameters. 
Constrained parameters assumed to be equal must be given the same values. 
Otheni/ise, start values may be chosen arbitrarily b^^it the closer they^ 
are to the final solution the less computer time it vdll take to reach 
the solution. - * , 




t 



Limitations Q % - ' - * 

The program is written in FOKrrWJ IV - G and has been tested out on" 
the IH^l 560/65 at Educational Testing Service- Double precision is used 
in floating point arithmetic throughout the program. With minor changes 
the program should run off'any computer with a FORTRAN IV compiler. 5^ 
computers with a single word length of 56 bits or more^ single precision 
is probably sufficient. 

Limitations as to the , maximum nuniber of variables^ the maximum number 
of independent and nonf ixed parameters^ and the maximum order of the .pa^an-, 
""T-r matrices allowed^ as well as^the core requirements of the program 
on the IBM 56o/6^ are given in ths follovdng table. 

max. no. of variables (p q^) before selection = 80 



max. no. of variables (p + q) after selection = 50 

max. P ^ ' =15 

max. 0 , =15 

max. m = 15 

max. n . = 15 

max. no. of independent parameters = 80 

max- ho. of nonf ixed parameters = 80 

core requirements (K = 102^ bytes = 256 \?:ords) = l^j-OK 



2. If . Availability 

A coijy of the program may be obtained by v/riting to Marielle van Thill; 
at ETS. The user m.ust provide a tai^e on v;hich the program will be loaded. 
The program v;ill be v.Titten on the tape with 80 characters per record. The 
tape will4)e unlabeled. The user must specify whether ho wants the tape 



blocked or unblocked^ on,7-track or O-track^ in EBCDIC or BCD mode;, as 
well as the density and parity required. Test data will at the end 
of the pi^ogrdm* The test data are .described in the Appendix. Anyoae 
using the program for the first time should make sure that the teat data 
run correctly. - ^ ^ 



2.^. Disclaimer ' ' ^ 

Although the program has been varying satisfactorily for all data 
analyzed so far^ no claim, is m.ade th^ t it is free of error anjr^o warranty 
is given as to the accuracy and f^onctioning of the program. 



/ 
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3* Input Data 

For each data to be analyzed, the input consists of the foUowJng: 

1. Title card 

2. Parameter card 
5. Input ir.atrix 

Specifications for selection of variables froth the 
input matrix 

5. Pattern matrices for the parameter matrices 

6. Fqualities 

7- Start values for thp parameter matrices 

8. New data set or a STOP card 
Sections 5-1 ^"hrough 5-8 describe in general terms the functio^^. and setup 
of each of the above quantities. Illustrative examples are given in the 
Appendix. 

Whenever a matrix or vector is read in it is preceded by a format 
card, containing at most.BO columns^ beginning with a left parenthesis and" 
ending with a right parenthesis. The format must specify floating point 
niimbers for the input matrix and paramei;er matrices, and fixed point numbers 
for th'^ pattern matrices, consistent with the ^y in which the elements of 
the matrix are p^onched on the l^ollowlng cards. Users who are unfamiliar 
with FORTi^N are referred to a FORTRAN *'..nual, where format rules are given. 

Matrices are to be punched as one lonR vector, reading row-wise. For the 

s^onmetrlc matrices only the lowe> half of the matrix includir ^ the ^diagonal 
should be punched . 

^ 

:>.l. Title Card * 

wTiatever appears on this card will appear on the first page of the 
printed output. All &) columns of the card are available to the user* 



\ 

0.2. Parameter Cnrd \ ' ' 

1 \ 

All quantities on this card^ except for the logical indicators; must 
be punched as integers right adjusted within the field. 

cols. 1-5 number of variables ( ) in y before selection 

cols. 6-10 number of variables ( ) in x before selection 

(i.e.; the input matrix S is of order 
(Pq ^ %) ^ (Pq before selection of ^ 

variables ; 

cols. 11 - 15 number of columns in ( ) 

cols. l6 - 20 number of columns in A ( n ) 

/ ~x 

cols. 21-25 ■ number of observations ( M ) 

cols. 26 - y;) total estimated execution time in seconds for all 

stacked data (SEC ). This should be^a number 
slightly less than the time requested on the 
control cards so^that the program will have time 
to print and/or punch results up to that point 
(Note- SEC should be read in for each data set 
and should be the same for all data sets in the 
stack. ) ' • ^ ' 

col. ^1 logical variable 

= F if .>here is no x ; i.e.; there are no A ; 

0 ; 9g • (in this case n = q = 0 ) ^ 
~ T othei'wise 

col. 42 logical variable 

= F if there are no disturbances ^ ^ i,e., there 

is no t 
- T otherwise 
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Logical variable 

= F if B = I . : 

= T otherwise 
logical variable 

= F if the exact solution is to be computed 

= T if the approximate solution is to be- computed 

logical variable 

= F if the solution is not to be punched on cards 
= T if the solution is to be punched on cards- 

This will automai^ically be done if IND ^ 0 

(see h.l and h.6) 
logical variable 

= F if variables are not to be selected frpm the 

input matrix 
= T if variables are to be selected from the 

input matrix 
logical variable** ^ > 

= F if the standardized solution is not to be printed 
- T if the standardized solution is to be 

printed (see h^k) 
= 1; if raw data ( y|x ) is read in to compute 

the matrix S to be analyzed 
= 2 if the input matrix is a -dispersion matrix ^ 
«= 3 if the input matrix is' a correlation matrix 
= ^ if the matrix to be analyzed is che same as^ 

in the preyious data set^ i.e.; the input 

matrix is not to be read in 
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coi. 52 



col. 'Xj 



= 2 



Note 



= 0 



= H 



r= 1 



= 2 
= 5 

= 5 

=. 6' 
= T 



if the matrix to be analyzed is sums of ' 
squares and cross products 
if* the matrix to be analyzed is deviation 
sums of squares and cross products 

Col. 52 can be 1 or 2 only if col. 51 ^ 1 
if the matrix to be analyzed is a dispersion 
^Inatrix - 

if the matrix to be analyzed is a 'correlation 

matrix ' ^ 

* 

if only the standard output is to be printed 
(see k.l) 

if the input matrix^ the specification 
matrices and the initial solution are to be 
printed 

-"if E ^- -the~Te^iduals and matrices C and D are 
to be pirLnted (see 
if both 1 and 2 apply 

if technical output from the minimization 
procediire is to 'be printed (see U.p) 
if both 1 and h apply 
if both 2 and k apply 
if 2 and k apply 
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Input Matrix 

If col. :>1 = 1 on the parametej card an M x /p^ -* q^) matrix ( yIx ) 
of raw data is read in, one roV at a time, starting a new card for ea ch rov, 
note that this is the o^ly input matrix not read in as one continuous long 
vector. The matrix is pr-eceded by a format card. 



If col^ ^1 = 2 or .3 on the parameter card the lower triangular part^ 
including the diagonal^ of the input matrix S' is read in^ reading row-wis 
By S ve mean the partitioned matrix 



The input matrix is preceded by a format card. If a correlation matrix is 
read in but a dispersion matrix is to be analyzed (i*e.^ col* pi =^ 3 and 



vector of standard deviations on subsequent cards. 

If col. ^1 = h on the parameter card the input matrix is not to be 
read in. 



These cards v;ill be read in only if column U6 = T and column 51 ^ 



on the parameter card. Omit othervrise. 

The first card v;ill have the integer values p and q punched in 
columns 1-5 and 6-10 resi\ectively^ ri 'ht adjusted v;ithin th-e fi-ld. These 
integers v/ili specify the order of S after selection ( p q < Pq ) • 

The next card(s) v/ill contain integers^ right adjusted in five 
column fields (i.e.^ sixteen such values will fit on one card) specifying 
\vidch columns frov/s) are to be included . For example^ if = ,6 ^ % ^ ^ 
and p = 3 ; q - 1 and columns (rov;s) 1^ 2^ 5^ 8 and 9 of S are to be 
excluded J then this card v;ill have a 3 punched in column 5^ and a k 




col. 52 = 3 ), the input matrix S is follpv/ed by a format card and a 



3-^r. Specifications for Selection of Variables frotn S 
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punched in column 10; a 6 punched in colurnn 15 and a 7 punched in column 

20- , . 

Note: If Pq + = P ^ there will be no reduction in the size of ^ 

S but columns (rows) can be interchanged. - 

3>5> Pattern Ma^rices for the Parameter Matrices 

The pattern matrices are preceded by a data card with entries in 

columns 1-8; the column defining the matrix in quest ion^ 1 for A ; 

2 for A, ; 5 for B ; ^ for P ; 5 for. 0. , 6 for , 7. for 9 ; 8 for 



cols- 1 - 8g CCCCCCCC where C = 0 if the matrix is fixed 

' C = 1 if the matrix is free 

C = 2 if the matrix has mixed values 

and/or constraints 

A pattern matrix should be provided only when C - 2 . (See 2.2-) 

For example; if columns 1-8 are punched 22002021 the matrices 

A , A ; <:> ; 9 contain mixed values and/or constraints; the matrices 

B ; 'P ; ^ are all fixed and matrix 0^ is all free. In this case only 

pattern matrices for A , A ; ci> and 9 are to be read in. 

~y ~x >^ ~6 

The pattern matrix consists of a format card specifying an I-fortilat 
and subsequent cards with the integer entries of the pattern matrix. 

'^•6. Equalities 

Omit if the pattern matrices do not contain any elements 2 or 5* 
Otherwise starting in column 1 punch the four-digit numbers ICCC as 
described in section 2.?. For each new constrained leader start a new 
card. The last entry on each "equality' card should be a zero indicating 
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more "equality" cards are to follow or a nine indicating it is the last 
one. In the example used in section 2.2 these carcis would look as 
follows : 

100110040 

. 100810110 . 
101510180 
700170020 

7005700i|0 
700570069 

3.7* Start Values for the Parameter Matrices 

Start values for eachjof the parameter matrices are read in^ each 
preceded by a format card^ and in the order previously* described (i.el^ 

and ' a*re read in. 

IT col. 4l = F on the parameter card do not read in 'start values for 
A , r , 0 and . 



~x 



B 



If col. 42 = Y on the parameter card do not read in a start value for 



If col. 4$ ^ F. on the parameter card do not read in a start value for 



3 '8. Stacked Bata 

In sections 5.I to 5-7 w have described how each set of data should 
be punched. Any number of such sets of data may be stacked together and 
analyzed in one run. After the, last set of data in the stack, there must 
be a card with the v/ord STOP punched in columns 1 - U . 
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h. Printed and Punched Output 

9 

• ' \ 

•The outTiut consists of a serici^s of printed and punched tables as 
described in sections ^.1.- ^.5. Exarrxples of printed outputs are given 
in the Appendix.. 

k*l» Standard Output 

The standard output is alv^ obtained; regardless of the value ^ 
punched in column 55 of the parameter card (see '5-2). The standard . > ' 

output consists of the title v/ith parameter listing^ the final solution^ 
and the result of the test of goodness of fit- 

The parameter listing gives the information supplied on the param- 
eter card» Z' 

The "final solution consists of the eight matrices A , A , B ^ ^ T ^ 

4) , ' \}f ; i ^ . All nambers are printed with three decimals. * ^ 

~ ' " 2 

The test of goodness of fit giyes the value of X and the cor- 
responding degrees of freedom. The probability level is also given. This • . 

p 

is defined as the probability of getting a X" value larger than that 
actually obtained^ given that the hypothesized model is true. 

Just above the table giving the final solution, the following message 
is printed' 

Usually X = 0 , but if, for some reason^ it has not been possible to 
determine the final 'solution, X will be 1, 2, 5, or 5- I^' IND is 
1, 2 or 5 , "serious problems" have been encountered and the minim^-zation 
the function cannot continue. One reason for this may be erroneous 



input data* Another reason may be that insuf/icient arithmetic precision 
is used. If TND is the number of iterations has e^^ceeded 250. If 
IND is the time limit SEC has been exceeded (see'^.2). ^ If IbW / 0 , 
the -solution obtained so far is "automatically pvxncThed on cards in ^such a 
v/ay as to be iminediately available as initial estimates for a nev ruri" 
with the same data*. Thus there is little loss of information when 
execution is terminated v/ith IND ^ 0 . * 

Input Matrix S and Param.eter Specif icatjLons 
If column 55 of the parameter card is 1, 5j 5 or 7 (see 5-2), the 
matrix to be analyzed^. S . as obtained after exclusion or interchanging of 
variables^ if any, is printed* 3y S we mean -the partitioned matrix 




The matrix S v:iil be printed first, followed by S and S 

-yy * ^ • -"xy --xx 

A table of parameter specifications, containing the information pzM^vided 
i?>y the pattern matrices and '^quality cards (see 2.2) is also printed. 
Integer matrices aro prifjted corresponding to the parameter matrices. In 
each matrix an element is an integer equal to the index of the corresponding 
parameter in the sequence of independent parameters. ^Elements corre- 

i 

sponding to fixed parameters are 0 ana elements corresponding to the sam.e 
constrained paramet^er have the same value. Examples are given in the 
Appendix. 

The initial solution or start values for the parameter matrices vrill 
also be printed. 
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k-^^* Matrices. E ^ C ; D and Residuals 

If column" 55 of the parameter card is 2, 5, 6 or 7 (see 3-2), the 

^ ys, 

matrices Z ^ C ^ D and residuals are printed^ 



The matrices E C ^ D are computed from the final solution* By 



E ^ C ; D we mean 




v/ber€ 



z = A *D'A' 
~>:y ~x y 



E = A -^h^- 31 



C = DI'D' + B ^^'B ' 



D = B r 

If the fit is good I should agree well with S. and the residual 

matrix, £ - S , should be small. Elements of the residual matrices may 

suggest how the hypothesized stiucture should be modified to obtain a 

better fit. The matrices are piinted row-wise, each element v;ith three 

♦ 

decimals. 

k.k* standardized Solution , 

If column ^7 or the paramete^' card is T (see 3^2), tl^e standardized 
solution ( A-^ , A^^ , , f^' , and ^ ) will be printed, a? well 

~ ~ 

as the standardized matrices and . That is: 
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~y 



A* 
~x 



r* = 

C» = 



A- A , 



A A- , 



/N_l /N/N 

A M , 

/N— 1 /N/N 

A ~rA, , 

/N-1 /N/N-l 



A M - 
~r| ^--Tj. 



A DA. , 



/\ — *] /\/N — 1 

A -^CA 



'•:nere 



A = (diag C) 



A. 



1/2 



(diag $) 



1/2 



Technical Output 

If column 55 of the parame uer 'card is 5 7 (see 5*2)/the techni- 
cal output is printed. This consists of a series of tables which describe 
the behavior of the iterative procedure and give various measures of the 
accui^acy of the final solution. Ordinary users will have little interest 

in these tables. 

The tables show the behavior of the iterative procedure under the j 
steepest descent iterations and under the following iterations by the Davidon- 
Pletcher-Pov/ell method. ^ For interpretation of these tables the reader 



is referred to Gruvaeus and J^reskog (1970). If something goes wrong, so 
that IND is 1, 2 or 5 (see h.l), these tables may contain valuab'le 
information* 

^*6* Punched Output . 

If column of the parameter card is T (see 5*2), the final solution 
is punched on cards. The matrices are punched on cards in vector form^ 
reading row-vdse, each preceded by a format card. Only the lower diagonal 
parts of ^^ and ^ will be punched, ^f column hi of the parameter card 
is F , A , f^ , e and P'-wiil not be punched. If column ^2 of the 
parameter card is F , '^r will not be punched. And if column h'^ of the 
parameter card is F ^ B will not be punched. 

If IND 0 (see^^ul), the final 'solution will be automatically 
punched, regardless of the value of column ^^5 Qn the parameter card. 
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Appendix 

Vic shall iLlustrate how input data are set up an^ what the printout 
looks like by nleans of three small data sets. These data also serve as 
test data to be run v/hen the program has been compiled on a different 
compute!^. 

Pages A5 - A*^^t shov; card by ca-^d how the input data are punched- One 
line corresponds to one card. Pages A5 - A5^ show the corresponding printout* 
obtained. 

Tne first set of data is the artificial data discussed in" section 1.^. 
ir.termedjate output As requested and the standardized solution is not 
printed. 

The second set of data is the model oT Duncan^ Haller and Portes 

discussed in section 1.5- /There is.no selection of variables from the 

ir^atri^;, but ccluiims (rows) are to be reordered. The standardized solution 

is requested and printsed. Note that the correct number of degrees of freedom 

is tv;elve and not 55 given by the program. Since we know the solution 

^ ^ B , we treated (I> as fixed at S when the program was run. But 
L ~/>: ^ ~ -xx 

I should be considered as free^ which accounts for the discrepancy in 
deforces of freedom. ^ 

/Jhe third set of data ^ is the restricted factor analysis model djs- 
cunsed in section 1.6. Note that this model n.-^ither ^ nor B are 
be read :n. Columns (rows) of the input matrix are to be reordered. 
Intermediate output is requested. 

F'-^r all three data sets both the input matrix and the matrix to be 
analyzed are correlation matrices. 



At various places in the output^ time estimates are print^^^d. The 
time shown is the time taken to compute the solution that follows the time 
estimate. This time includes only the iterations and not the time for 
printing^ except possibly the technical prihtout. 
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